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Abstract: In this paper, we consider the coordination control of a group of autonomous mobile agents with multiple leaders. 
Different interconnection topologies are investigated. At first, a necessary and sufficient condition is proved in the case of 
fixed interconnection topology. Then a sufficient condition is proposed when the interconnection topology is switched. With 
a simple first-order dynamics model by using the neighborhood rule, both results show that the group behavior of the agents 
will converge to the polytope formed by the leaders. 
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1 INTRODUCTION 

Recent years have seen a large and growing literature con- 
cerned with the coordination of a group of autonomous 
agents, partly due to a broad application of multi-agent sys- 
tems including flocking/swarming (e.g., ||5l |6|), formation 
control (e.g.,|JL^), and sensor networks (e.g., fSl). Leader- 
following problem is one of the important coordination prob- 
lems in the studies of multiple mobile agents. Even in some 
leaderless cases, concepts like "virtual leader" are proposed 
to study cooperative behaviors ||9] [T3] . 
Usually, there is only one leader in the leader-following for- 
mulation, though sometimes, the leader may be active with 
unmeasurable states |4|. However, in some practical situa- 
tions of formation or foraging, the formulation of multiple 
leaders may be needed. In [2 |, Lin et al. discussed an inter- 
esting model for a group of agents with straight-line forma- 
tion containing two "edge leaders", where all the agents con- 
verge to a uniform distribution on the line segment specified 
by the two edge leaders. In fS), a simple model was given to 
simulate foraging and demonstrate that, the larger the group 
is, the smaller the proportion of "leaders" is needed to guide 
the group. 

Inspired by lISlO, in this paper we consider the coordination 
behavior of mobile agents with multiple leaders. By using 
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a neighborhood rule, we show that a group of agents will 
converge to the polytope formed by the leaders (that is, the 
leaders forms the vertex set of the polytope) in two differ- 
ent cases of interconnection topologies associated with the 
agents and the leaders, and demonstrate that the collective 
behavior changes as the connectivity of the interconnection 
between agents and some leader increases through some sim- 
ulations. 

This paper is organized as follows. Section 2 presents the 
problem formulation for multiple leaders. Then, both fixed 
interconnection topology and switched topology are consid- 
ered, and the corresponding coordination behaviors are ana- 
lyzed in Sections 3 and Section 4. In Section 5, two numerical 
examples are shown. Finally, concluding remarks are given 
in Section 6. 

2 PROBLEM FORMULATION 

Before formulating our problem, we first introduce some ba- 
sic concepts and notations in graph theory that will be used 

Let Q = {V,£,A)hea weighted undirected graph of order n 
with a set of nodes V — {1, 2, .... n}, set of edges £ CV xV, 
and a weighted adjacency matrix A = [uij] £ 7^"X" with 
nonnegative elements. The node indexes belong to a finite 
index set T = {1,2, ...,n}. An edge is denoted by 
which means node i and node j are adjacent. A path from i 
to j in is a sequence of distinct nodes starting with i and 
ending with j such that the consecutive nodes are adjacent. If 



there is a path between any two nodes of a graph Q, then Q 
is connected, otherwise disconnected. An induced subgraph 
XofG that is maximal, subject to being connected, is called 
a component of Q. The element associated with the edge 
of the graph is positive, i.e. > ^ (i, j) E £. Moreover, 
we assume an = for all i G X. The set of neighbors of 
node i is denoted by Afi = {j £ V : G £}■ 
A diagonal matrix D = diag{di, dn} G Ji^'-x^^ is a degree 
matrix of Q, whose diagonal elements di = J^jeAf- '^v ^'^^ 
i = 1, 71. Then the Laplacian of the weighted graph Q is 
defined as L — D — A £ i?"^". The following result is well- 
known in algebraic graph theory (e.g. ifTol ) and establishes 
a direct relationship between the graph connectivity and its 
Laplacian. 

Lemma 1 Let Q be a graph on n vertices with Laplacian 
L. Denote the eigenvalues of L by Ai(L), • • • , A„(L) sat- 
isfying Xi{L) < ■■■ < Xn{L). Then Xi{L) — and 
1 = [1, 1, • • • ,1]^ G -R" is its eigenvector Moreover, if Q 
is connected, A2 > 0. 

Next, we introduce some notations in convex analysis lfT2l 
and linear algebra ifTTl . Let S C i?™. S is said to be convex 
if (1 — j)x + -fy £ S whenever x £ S,y £ S and < 
7 < 1. A vector sum 712:1 + • • • + jnXn is called a convex 
combination of xi, • • • , a:„ if the coefficients 7^ are all non- 
negative and 71 + • • • + 7n ~ 1- Here, ji can be interpreted 
as proportions. The intersection of all convex sets containing 
S is the convex hull of S, denoted by co{S). The convex 
hull of a finite set of points xi, - ■ ■ , x„ G i?™ is a polytope, 
denoted by co{xi, • • • , x„}. If X2 — xi, ■ ■ ■ , Xn ~ xi are 
linearly independent, the set of points xi, - ■ ■ , x„ is said to 
be affinely independent. Then the polytope is called an n — 1 
dimensional simplex and xi, - ■ ■ ,x„ are called the vertices 
of the simplex. 

In this paper, we consider a system consisting of n agents 
and k leaders, and the interconnection topology among them 
can easily be described by a simple graph. The purpose of 
the leaders is to guide the multi-agent behavior. Denote the 
positions of these static leaders by Xq £ K"\j = 1, • • • ,k. 
The interconnection topology G associated with n agents can 
be fixed or variable but may not be connected. If we regard 
the polytope formed by leaders as a virtual node and if one 
agent can see a vertex (i.e. some leader) of the polytope, we 
say that the agent is connected to the virtual node. By "the 
graph, Q, of this system is connected", we mean that at least 
one agent in each component of Q is connected to the virtual 
node. Then we define a diagonal matrix B to be a leader 
adjacency matrix associated with Q with diagonal elements 



bi [i £ T) such that each hi is some positive number if agent 
i is connected to the virtual node and otherwise. 
A continuous-time dynamics of n agents is described as fol- 
lows; 

Xi=Ui, (1) 

where Xi £ R™' can be the position of agent i and Ui £ R™- 
its interconnection control inputs for i = 1, ...,n. As usual, 
we propose a neighbor-based feedback control as follows: 

k 

j&N,{cr) q=l (2) 

i ^ 1, - ■ ■ , n. 

where nonnegative functions bf{a{t)) > if and only if 
agent i is connected to leader q {q — 1, - ■ ■ ,k) when t £ 
[i;, i;+i) for I = 0,1, ■ ■ ■ , and switching signal a : [0, 00) 
V = {!,..., N} (N £ Z+, denotes the total number of all 
possible digraphs) is a switching signal that determines the 
interconnection topology Q. If cr is a constant function, then 
the corresponding interconnection topology is fixed. 
Denote 




£ H ,Xq— 



V 



G R" 



Let B$ = diagibHait)),- ■ ■ ,bl{a{t))} £ i?"^" be a di- 
agonal matrix with non-negative diagonal entry bf{a{t)) for 
q ^ ,k and B„ = [Bl,---,B^] £ R^^^^. Let 

s = U=(6,---,Cn)^ie. ecoK,---,xg}}. 
Then we rewrite the closed-loop system in a compact form: 



X £ F{x), 



(3) 



with a set-valued function 



F{x) = {-{Hp (g) Im)x + [Bpih (g) In)] «) ImXo\p £ V} 



and 



Hp Lp + Bp{lk ® In 



where (g) is the Kronecker product. 

Throughout the paper, i?+ — [0,oo),\ \ ■ \ \ denotes the Eu- 
clidean norm and < •, • > denotes inner product on i?™". 
For non-empty S C i?"'", ds ■ i?™" R^ denotes its Eu- 
clidean distance function given by dsix) = \inf\ \x — ^| p. 

The objective of this work is to lead all the agents to enter the 
region formed by the leaders; namely, Xi {i = \, - ■ ■ ,n), for 



each agent i, will be contained in a convex hull of Xq [j = 
1, • • • , k) as t oo. In other words, 

lim ds{x{t)) = 0. (4) 

t — >oo 

In the following sections, the convergence of the system (O 
will be studied based on ds{x), with either fixed interconnec- 
tion topology or switched interconnection topology. 

3 FIXED INTERCONNECTION TOPOLOGY 

In this section, we will focus on the convergence analysis of a 
group of dynamic agents with fixed interconnection topology. 
In this case, the subscript a can be dropped. 
Then the differential inclusion (O becomes 

X = -{H ® I,n)x + [B{Ik (E) In)] «) ImXo- (5) 

The next lemma shows the relationship between the positive 
definiteness of a matrix H = L + B{lk ^ In) and the con- 
nectivity of Q, which was proved in llj. 

Lemma 2 // graph Q is connected, then the symmetric ma- 
trix H associated with Q is positive definite. 

Then a main result associated with the fixed interconnection 
topology is given as follows: 

Theorem 1 For the system (O, holds if and only if Q is 
connected. 

Proof: (Sufficiency) Let x ~ x — [H^^B{Ik ^ In)] <8i ImXo- 
Then, from equation (|5]l, we have 

X ^ -{H (g) Im)x. (6) 

For any initial value x{to) at initial time to, the solution of 
the system (|6]l is 

x{t)^e-^"'^'^^^'''°^x{h), t>to. 

From Lemma|2] the eigenvalues of H (E) Im are positive, and 
therefore, x(t) 0; namely, x ^ x* = [H^^B{Ik ® 1„)] 
ImXo, as i — !■ oo. 

Then we only need to prove that each vector x* E i?™ {i = 
1, • • • ,n) can be represented by a convex combination of 
Xq e i?™ for p = 1, ■ ■ ■ , k. It is equivalent to prove that 
[II~^B{Ik E) In)] <X) Im is a row stochastic matrix which is a 
non-negative matrix and the sum of the entries in every row 
equals 1. 

For H, there exists a positive number a such that H = al — 
M, where M is a non-negative matrix and a > p{M) with 
p{M) = max{\/A, A is an eigenvalue of M^M}. In fact. 



the eigenvalue Xi{II) ~ a — \i{M) > 0,i — 1, - • • ,n. 
Thus, 

{al ~ M)-i = -(/ + -M + + •••)> 0„x„ 

or equivalently, {H^^ (g) /„) is a non-negative matrix, and so 
is [H-^B{Ik (g) 1„)] ® Im. 
Additionally, since 

k 

{H (g) /„)(!„ Im) = B^n) (E> Im, 

we have 

k 

{H<E>Im)~\Yl Bnn)<E>lm 
9=1 

= {{H (g) Im)^^[B{Ik (E) In)] ® Im){U ® Im) 
^{[H~^B{Ik (E) In)] E) Im){U E) Im) = 1„ » Im- 

Note that [II^^B{Ik ® In)] ® Im is a matrix with every row 
sum equal to 1, which leads to the conclusion. 
(Necessity) Suppose that Q is not connected. Without loss of 
generality, we also suppose that there are n components in Q, 
where some components are connected with the virtual node. 
We can renumber the nodes of V such that Laplacian matrix 
associated with Q takes the following form 

V L22 ) 

and, correspondingly, 

where Ln E R^^^{0 < s < n) is the Laplacian associ- 
ated with those components connected with the virtual node, 
Bf^ G i?''^" is a nonzero diagonal matrix and O's denote 
some appropriate zero matrices. 

Let X = {yl, yj)^ with yi e i?^™; e Then dU 

become: 

2/1 = -{Hi® Im)yi + [Bl{IkE)ls)]E) ImXo, 

h = -{L22® Im)y2, 

where Bi = [Bl^, ■■■ , Sf^], i/i = Lii+Bi{Ik®\s)- From 
the proof for the sufficient condition, it follows that s agents 
corresponding to yi will approach to the leaders for an ar- 
bitrary initial conditions. However, the other agents corre- 
sponding to 2/2 will stay static or diverge to some distinct lo- 
cations which can arbitrarily exist and may not belong to the 
polytope co{xq, • • • , This leads to a contradiction. I 

Remark 1 If k = 1, then Theorem\l\will be consistent with 
Theorem 4 in [4]. 



4 SWITCHED INTERCONNECTION TOPOL- 
OGY 

In this section, we consider the system ^ associated with 
switched interconnection topology. A resuh is given as fol- 
lows. 

Theorem 2 For the system di]), ifGp (p G V) is connected, 
then holds. 

Proof: Since the topology Qp {p E V) is connected, from 
Lemma|2l Hp {p £ V) keeps positive definite, and moreover, 
[Hp^Bp{Ik (E) In)] 'S) Im is a row stochastic matrix. Obvi- 
ously, [Hp^Bp{Ik (8) In)] (i> ImXo e S, from the differential 
inclusion (O, we have 

X e F{x) = {-{Hp ® -CMeE,pe V}. (7) 

Consider the Dini derivative of d-B{x{t)), 



D+dE{x{t)) 



= inf < x — ^, i > 
< -\ids{x{t)), 



In the first example, we take n = 5,k — 2,m — l,to = 
and the initial positions of agents and leaders are given as 
follows: 



a;i(0) = 5, 2:2(0) = 5.5, 0:3(0) = 6, 2:4(0) = 7, 



(8) 



2:5(0) = 6.5, xl = 1, xl 



Then the simulation results show that the group of agents will 
approach to the segment connecting the two leaders in Figs 
3 — 6. In Fig. 4, when the number of agents linked to leader 1 
increases, the agent group will move to leader 1 more closely. 
Moreover, in Fig. 6, when agent 5 is sensed by other agents, 
then it also moves to leader 1. In Fig. 5, though agent 2 is 
not connected with other agents but linked to leader 1, then it 
will reach the locality of leader 1 finally. 



where Ai is the smallest (positive) eigenvalue of all possible 
Hp forp e V. Hence, d-E{x{t)) is a decreasing nonnegative 
function and d-E.{x{t)) = if and only if x{t) £ S, then we 
have dE{x{t)) as t ^ 00. I 

5 NUMERICAL EXAMPLES 

In this section, we give numerical simulations to illustrate 
the coordination of multi-agent systems with multiple lead- 
ers. The following two examples are considered (see Fig. 1 
and Fig. 2). 
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Fig. 2. Q2 and Q2 




1 50 ZOO 250 



Fig. 3. Coordination behavior withe the topology shown in Fig. 1 
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Fig. 4. Coordination behavior based on revised Fig. 1, 
where agents 2,3 and 4 connected with leader 1 
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Fig. 5. Coordination behavior with the topology 
associated shown in Fig. 3 with agent 2 
disconnected with agents 3 and 4 
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Fig. 6. Coordination behavior with the topology 
associated shown in Fig. 3 with agents 2 and 4 
connected with agent 5 

In the second simulation example, we take n — 5, A: ^ 
3, m = 2, ^0 = and the initial positions of agents and lead- 
ers are given as follows: 

xiiO) = (0,0f , X2{0) = (l,Of , X3(0) = (2,0f , 

Xi{0) = (3,0)^, X5{0) = (4,0)^, xl = (l,lf , 

xl^{2,2f, xl^{l,2f. 

Here, the agents take a straight-line formation at the begin- 
ning. 
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Fig. 7. Coordination behavior related to Fig. 2 



From Fig. 7, we observe that this group of agents will en- 
ter the triangle formed by three leaders. Moreover, during 
the evolution, agents 2, 3, 4, and 5 still remain straight-line 
formation. 

6 CONCLUSIONS 

This paper addressed a coordination problem of a multi-agent 
system with multiple leaders. This group of agents were 
shown to approach to the region "contained" by the leaders if 
the interconnection graph is connected. Two interconnection 
cases, fixed topology and switched topology, were discussed. 
Moreover, numerical simulations were given to illustrate the 
theoretical analysis. 
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